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2,0  SUMMARY 


This  report  describes  a  field  evaluation  of  the  Stress  Resilience  Training  System  (SRTS), 
which  provides  a  combination  of  cognitive  learning  and  biofeedback-based  methods  to 
enhance  resilience,  delivered  via  classroom  instruction,  mentoring,  and  a  tablet  computer. 

The  system  was  evaluated  with  a  population  of  active  duty  Airmen  experiencing  significant 
occupational  stress.  Changes  in  stress,  mental  health,  and  occupational  burnout  were  assessed 
before  and  after  an  eight  week  training  period.  Significant  improvement  in  overall  stress  was 
observed;  however,  there  were  no  significant  changes  in  the  other  metrics.  This  may  have 
been  a  consequence  of  the  limited  study  period;  however,  overall  participation  and 
compliance  with  the  training  program  were  lower  than  anticipated  and  likely  influenced 
results.  This  study  therefore  provides  evidence  supporting  the  efficacy  of  SRTS. 


3.0  INTRODUCTION 

Occupation-related  stress  is  an  unavoidable  consequence  of  military  service.  The  exact 
causes  of  this  stress  vary  significantly  based  on  location,  role,  and  mission.  Regardless  of 
cause,  the  accumulation  of  stress  over  time  can  lead  to  burnout  (Taris,  LeBlanc,  Schaufeli,  & 
Schreurs,  2005;  Wright  &  Hobfoll,  2004)  and  subsequent  declines  in  mental  health, 
particularly  relating  to  career  satisfaction  and  work  overload  (e.g.  Prosser  et  ah,  1997, 
Schaufeli  &  Enzmann,  1998).  In  their  2009  study  of  Air  Force  personnel  who  had  been 
deployed,  Vinokur,  Pierce,  and  Lewandowski-Romps  correlated  burnout  with  overall 
perceived  health.  They  found  that  there  is  a  reciprocal  relationship  over  time  between 
burnout  and  perceived  health,  creating  the  possibility  of  a  destructive  descending  spiral.  As  a 
result,  there  is  considerable  need  for  and  interest  in  methods  and  techniques  that  can  reduce 
these  negative  outcomes  or  increase  resilience  in  the  face  of  such  stress. 

Psychological  resilience  is  seen  as  a  key  component  of  duty  fitness,  particularly  for  units  and 
personnel  who  are  frequently  forward  deployed.  Service  members  who  are  deploying  for 
extended  periods  on  a  repeated  basis  face  risks  associated  with  combat  that  may  challenge 
individuals’  and  families’  coping  resources  (Bell,  Bartone,  Bartone,  Schumm,  &  Gade, 

1997).  While  most  military  personnel  and  their  families  report  coping  successfully  under 
these  difficult  circumstances,  many  also  experience  difficulties  handling  stress  at  some  point. 
Studies  of  recent  military  conflicts  have  documented  that  deployment  stressors  and  exposure 
to  combat  can  result  in  mental  health  problems,  including  post-traumatic  stress  disorder 
(PTSD),  major  depression,  and  impairment  in  social  functioning.  Given  ongoing  military 
operations,  mental  disorders  are  likely  to  remain  an  important  health  care  concern  among 
combat  veterans.  As  many  as  nine  percent  of  soldiers  may  be  at  risk  for  mental  disorders 
before  combat  deployment,  and  as  many  as  1 1  to  17  percent  may  be  at  risk  for  such  disorders 
three  to  four  months  after  their  return  from  combat  deployment  (Hoge  et  al.,2004).  As  a 
result,  service  members’  resilience  (ability  to  withstand,  recover,  grow,  and  adapt  under  these 
challenging  circumstances)  is  vital  to  force  protection.  Without  such  resilience,  service 
members’  performance  (ability  to  successfully  complete  tasks)  suffers  and  their  fitness  and 
readiness  for  deployment  is  adversely  affected  (Bates  et  ah,  2010).  There  are,  however, 
programs  and  strategies  available  to  promote  and  support  psychological  resilience  to  stress, 
specifically  deployment-related  stress  (Meredith  et  ah,  2011).  Currently  available  programs 
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include  one  or  more  interventions  drawn  from  a  wide  variety  of  approaehes,  sueh  as  positive 
psychology,  cognitive-behavioral  therapy,  eommunity-based  interventions,  physieal  fitness 
training,  and  communication  skill  development. 

Personnel  can  adapt  to  repetitive  stress  and  develop  inereased  psychologieal  resilienee,  a 
proeess  described  as  stress  adaptation  or  inoculation  (Meichenbaum  &  Cameron,  1989; 
Rosebush,  1998).  Training  can  initiate  or  accelerate  this  proeess,  espeeially  with  experienced 
military  personnel  who  are  able  to  control  and  even  utilize  stress  productively.  A  key  part  of 
what  experienced  personnel  learn  is  self-awareness  of  their  stress  state  and  self-regulation  of 
stress  effeets.  These  skills  may  be  enhanced  by  combining  cognitive  learning  methodologies 
grounded  in  learning  theory  and  biofeedback  techniques  based  on  heart  rate  variability 
(HRV)  with  simulation  game-based  training  tools,  as  encapsulated  in  the  Stress  Resilience 
Training  System  (SRTS). 

The  visual  or  auditory  depiction  of  your  own  physiological  signals  in  real  or  near-real  time 
has  been  studied  for  some  time  under  the  biofeedback  paradigm.  In  this  paradigm,  persons 
learn  to  control  signals  associated  with  autonomie  arousal  by  continuously  observing  their 
own  signals,  while  engaging  in  mental  exercises  or  imagery  intended  to  reduce  arousal. 
Biofeedback  has  been  shown  to  reduce  subjeetive  stress,  lower  depression  scores,  deerease 
anxiety  in  athletes,  and  reduee  hypertension  (Siepmann  et  ah,  2008;  Baehr,  Rosenfeld,  and 
Baehr,  2001;  Costa,  Bonaceorsi,  and  Scrimali,  1984),  though  there  also  have  been  null 
results  with  treating  PTSD  in  a  Vietnam  veteran  population  (Silver,  Brooks,  and  Obenchain, 
1995).  This  prior  work  substantiates  that  biofeedback  has  the  potential  to  be  an  effeetive 
teehnique  for  enhancing  stress  resilience  in  military  members,  though  likely  in  the  context  of 
a  more  eomprehensive  intervention. 

The  SRTS  is  based  on  the  HeartMath  cognitive  learning  approach  with  biofeedback.  SRTS 
aims  to  increase  complianee  when  delivered  to  a  broader  military  population  by  packaging 
the  training  system  in  an  application  on  a  tablet  eomputer,  specifically  an  iPad.  This 
application  incorporates  some  game-based  elements  intended  to  provide  intrinsie  incentives 
for  regular  use.  Games  have  been  shown  to  enhance  motivation  and  engagement  (reviewed  in 
Hamari,  Koivisto,  &  Sarsa,  2014),  particularly  for  younger  personnel  who  are  used  to  game- 
play  in  their  off-duty  lives.  Games  eontrolled  by  the  user’s  biology  (e.g.,  HRV-eontrolled 
games)  provide  a  unique  and  highly  immersive  gaming  experienee  (Prensky,  2001).  These 
findings  have  been  adopted  in  the  SRTS  so  that  trainees  learn  to  inerease  HRV  (indieative  of 
redueed  stress)  while  progressing  from  easy  to  highly  challenging  levels  of  HRV-eontrolled 
games,  culminating  in  a  racing  simulation  requiring  fast  reactions  while  maintaining  HRV 
(high  coherenee). 

While  previous  work  has  established  the  utility  of  biofeedback  and  the  incentive  potential  of 
game-based  training,  this  evaluation  will  seek  to  confirm  or  refute  the  combination’s 
effectiveness  in  a  sample  of  Air  Force  personnel  experieneing  signifieant  operational  and  life 
stress. 
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4.0  METHODS 


4.1  Participants 

Participants  were  all  drawn  from  members  of  an  Air  Force  Seeurity  Forces  Squadron  that 
was  experieneing  frequent  overseas  deployment  rotations  at  the  time  the  study  was 
conducted.  Twenty-seven  participants,  23  men  and  4  women,  took  part  in  the  study.  To 
preserve  anonymity,  exact  numbers  were  not  collected  for  many  demographic 
characteristics;  participants  were  instead  asked  to  endorse  eategorieal  ranges.  The  most 
frequently  endorsed  age  category  was  22-25  years  (52%  of  partieipants)  with  less  than 
four  years  of  service  (52%  of  participants).  Most  participants’  ranks  were  E4  and  below 
(67%  of  participants)  and  had  been  assigned  to  their  eurrent  duties  for  25  months  or 
longer  (56%  of  participants).  All  of  the  participants  had  been  deployed  overseas  prior  to 
the  study,  15%  within  the  preeeding  six  months.  Fifty-nine  pereent  had  been  required  to 
eonduet  off-base  patrols  or  other  sueh  duties  during  deployment  involving  inereased  risk 
of  eombat  exposure.  Serviee  members  were  informed  of  the  study  via  email  from  the 
researeh  team  after  endorsement  from  the  squadron  commander.  After  a  group 
informational  briefing,  researchers  met  with  eaeh  volunteer  individually.  Prospeetive 
participants  were  reminded  of  the  purpose,  duration,  proeedures,  risks,  benefits, 
eonfidentiality  issues,  the  voluntary  nature  of  partieipating,  what  was  expected  of  them, 
and  their  rights  as  participants.  These  individual  meetings  were  monitored  by  a  neutral 
mental  health  professional  who  provided  both  research  and  medical  oversight.  Service 
members  who  agreed  to  participate  then  completed  full  written  informed  eonsent. 

4.2  Equipment 

Eaeh  partieipant  was  asked  to  eomplete  a  written  inventory  package  that  ineluded  the 
following  structured  assessments: 

Burnout.  Burnout  was  assessed  with  the  Maslaeh  Burnout  Inventory  General  Survey 
(MBI-GS;  Maslaeh,  Jackson,  &  Eeiter,  1986).  The  MBI-GS  is  a  well-established  measure 
of  burnout.  The  measure  consists  of  three  subscales:  exhaustion,  cynicism,  and  reduced 
professional  efficacy  with  5,5,  and  6  items  respeetively.  All  items  are  seored  on  a  seven- 
point  asymmetrical  rating  scale  ranging  from  0  (“never”)  to  6  (“daily”). 

Psychologieal  Well-Being.  The  Outcome  Questionnaire  -  45.2  (OQ45,  Eambert  et  ah, 
2000)  was  designed  to  be  a  brief  and  eost  effective  struetured  self-report  measure  of 
overall  mental  health.  It  is  commonly  used  to  assess  clinieal  outcomes;  however,  it  also 
provides  general  measures  enabling  the  comparison  of  functioning  across  three  subscales, 
specifically  symptom  distress,  interpersonal  relations,  and  soeial  role.  The  OQ45  has 
been  extensively  validated  (e.g.  Doerfler,  Addis,  &  Moran,  2002;  de  Jong  et  ah,  2007). 

Role  Stress.  Role  stress  was  assessed  using  fifteen  items  that  reflect  role  conflict,  role 
ambiguity,  and  role  overload  (five  items  eaeh).  A  sample  item  measuring  role  conflict  is: 
“I  receive  incompatible  requests  from  two  or  more  people.”  A  sample  role  ambiguity 
item  is:  “I  know  exaetly  what  is  expected  of  me  (reverse  coded).”  A  sample  role  overload 
item  is:  “It  seems  like  I  have  too  much  work  for  one  person  to  do.”  Items  were  presented 
in  statement  format  with  a  five  point  response  scale  ranging  from  1  (Strongly  Disagree) 
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to  5  (Strongly  Agree).  Scale  scores  were  computed  by  averaging  items  within  each  scale 
such  that  higher  scores  indicate  greater  endorsement  of  the  items  within  the  scale.  The 
items  have  demonstrated  adequate  structural  fit  in  a  variety  of  cross-cultural  samples 
(Glazer  &  Beehr,  2005). 

Post-Traumatic  Stress.  This  was  assessed  via  the  PTSD  Checklist,  military  version  (PCL- 
M;  Weathers,  Huska,  &  Keane.,  1991),  a  17-item  instrument  that  corresponds  to  the 
Diagnostic  and  Statistical  Manual  of  Mental  Disorders  criteria  (DSM-IV-TR;  American 
Psychological  Association,  2001).  The  PCL  has  demonstrated  excellent  psychometric 
properties  in  a  variety  of  populations  (Weathers  &  Ford,  1996;  Yeager,  Magruder, 

Knapp,  Nicholas,  &  Frueh,  2007). 

In  addition  to  these  structured  assessments,  the  package  included  the  basic  demographic 
questions  discussed  above,  simple  workload  ratings  derived  from  the  NASA  Task  Load 
Index  (NASA-TLX;  Hart  &  Staveland,  1988),  and  a  single  overall  subjective  stress 
rating:  “Rate  the  level  of  operational  stress  of  your  job  over  the  past  3  months  on  a  0  (no 
stress)  to  10  (extreme  stress)”. 

Each  participant  was  provided  with  an  iPad  preloaded  with  SRTS  software,  an  ear  clip 
heart  rate  sensor  (photoplethysmograph)  that  interfaced  to  the  iPad,  and  a  protective  case 
for  the  iPad.  Entertainment  functions  of  the  iPad  were  disabled  to  accommodate  usage  on 
duty. 

4,3  Procedures 

hollowing  the  completion  of  written  informed  consent,  participants  were  then  provided 
with  the  questionnaire  packet.  After  completing  the  packet,  participants  were  assigned  to 
receive  either  a  standard  intervention  or  SRTS.  Those  assigned  to  SRTS  were  issued 
iPads  and  received  an  initial  training  lasting  approximately  2  hours  on  the  SRTS  program 
and  device  usage,  delivered  by  Ease  Interactive  personnel.  The  standard  intervention 
consisted  of  an  approximately  2  hour  stress  resilience  briefing  delivered  by  the  base  local 
Military/E amily  Eife  Counselor,  who  was  instructed  to  maximize  the  effectiveness  of  this 
briefing  to  the  best  of  his/her  abilities.  This  intervention  was  intended  to  represent  the 
current  standard  of  care  for  stress  resilience  in  the  Air  Eorce  and  offer  a  realistic 
comparison  to  the  efficacy  of  SRTS  given  the  possibility  of  placebo  effects. 

Participants  in  the  SRTS  group  were  asked  to  provide  contact  information  for  four 
telephone  contacts  during  the  study.  HeartMath  consultants  attempted  to  contact  each 
participant  via  phone  to  provide  mentoring,  additional  education,  check  on  progress,  and 
address  any  questions  or  issues  participants  had.  No  equivalent  formal  check-in  was 
accomplished  for  the  standard  intervention  group,  again  to  replicate  the  current  standard 
of  care.  Participants  were  instructed  to  target  their  iPad  training  usage  at  60  minutes  per 
week,  broken  up  ideally  into  three  20-minute  sessions. 

Eollowing  the  8  week  intervention  period,  all  participants  returned  any  study  equipment 
and  were  invited  to  complete  a  second  package  of  written  inventories,  identical  to  the 
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first.  The  returned  iPads  provided  the  study  team  with  summary  usage  statisties  including 
number  of  times  the  application  was  launched  and  total  duration  of  usage. 

5.0  RESULTS 

The  proportion  of  prospective  participants  who  agreed  to  participate  in  the  study  was 
substantially  lower  than  originally  anticipated  at  approximately  20%  of  eligible  personnel 
assigned  to  the  unit.  This  constrained  both  the  power  of  the  study  and  the  assignment  to 
groups.  Group  assignment  was  heavily  weighted  toward  the  SRTS  group  to  facilitate 
detection  of  pre/post  changes  at  the  cost  of  the  power  of  the  between-groups  comparison; 
20  participants  were  enrolled  in  the  SRTS  condition  and  7  in  the  standard  intervention. 
Participant  numbers  were  further  reduced  by  participants  who  were  unable  to  complete 
the  follow-up  assessment,  most  commonly  due  to  unexpected  reassignment  or 
deployment  needs.  A  total  of  17  participants  completed  all  phases  of  the  study,  13  in  the 
SRTS  condition  and  4  in  the  standard  intervention  condition. 

5.1  Burnout 

Results  from  the  Malasch  Burnout  Inventory  suggest  that  burnout  in  this  population  was 
moderately  high,  with  30%  of  participants  exceeding  a  sum  score  of  20  on  one  or  more 
subscales.  This  proportion  exceeds  that  observed  for  the  general  Air  Force  population 
(Chappelle  et  al,  2013)  and  is  comparable  with  highly  tasked  intelligence  and  remotely 
piloted  aircraft  (RPA)  operations  units.  In  contrast  to  those  units,  burnout  in  our  Security 
Forces  sample  was  driven  largely  by  cynicism  as  opposed  to  emotional  exhaustion  or 
concerns  about  professional  efficacy;  the  proportions  exceeding  cutoff  for  those  subscales 
were  consistent  with  the  general  Air  Force  population  at  15%.  We  did  not  observe  any 
changes  in  the  rate  of  personnel  exceeding  cutoff  thresholds  for  burnout  as  a  function  of 
SRTS  usage,  nor  did  we  observe  significant  correlations  between  minutes  of  SRTS  usage 
and  changes  in  burnout  scores. 

5.2  Psychological  Well-Being 

A  total  score  on  the  OQ45.2  of  63  or  greater  indicates  high  levels  of  distress  (Lambert  et 
ah,  2000).  Eight  of  the  28  participants  enrolled  met  or  exceeded  this  threshold  on  the 
initial  assessment;  in  the  post-intervention  assessment,  two  SRTS  participants  fell  below 
threshold.  Due  in  large  part  to  the  small  groups,  there  were  no  statistically  significant 
differences  in  OQ45.2  score  as  a  function  of  SRTS  vs.  standard  intervention.  If  the 
proportion  of  enrolled  participants  is  reflective  of  OQ-45.2  scores  for  the  unit  as  a  whole, 
there  is  some  cause  for  concern  regarding  psychological  well-being  as  the  29%  rate  is 
well  above  other  Air  Force  populations,  which  range  from  9-15%  (Chappelle  et  ah, 

2013).  Self-selection  bias  in  choosing  to  participate  in  the  study  may  have  somewhat 
inflated  this  estimate. 

5.3  Role  Stress 

The  three  subscales  of  role  stress  (conflict,  overload,  and  ambiguity)  were  individually 
scored,  with  endorsement  averaging  greater  than  5/7  assessed  as  indicative  of  significant 
role  stress  for  that  dimension  (Chappelle,  et  ah,  2013).  The  proportion  of  participants 
exceeding  this  threshold  for  overload  was  quite  low  at  4%,  while  ambiguity  and  conflict 
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were  more  prevalent  at  1 1%  and  19%,  respectively.  Role  conflict  was,  therefore, 
identified  as  a  significant  factor  in  overall  occupational  stress,  though  this  rate  still  falls 
well  below  canonical  examples  of  high  role  stress  such  as  hospital  floor  nurses  (28%). 

5.4  Post-Traumatic  Stress 

The  PTSD  Checklist,  military  version  (PCL-M)  results  indicated  that  1  participant  (4%  of 
the  total)  exceeded  the  cutoff  threshold  associated  with  high  risk  of  PTSD.  This 
participant  was  part  of  the  SRTS  group,  and  his/her  score  did  not  change  significantly 
from  pre  to  post  assessment. 

5.5  Overall  Stress 

Unidimensional  overall  stress  ratings  in  the  SRTS  group  declined  from  pre  to  post,  with 
12  of  13  participants  (92%)  reporting  the  same  or  lower  levels  of  overall  stress.  This 
contrasts  with  the  standard  intervention  condition,  where  2  of  4  participants  reported 
same  or  lower  levels.  The  mean  decline  was  modest  though  significant  at  1  point  lower 
on  the  10  point  scale.  Statistical  significance  was  assessed  via  sign  test,  resulting  in p<.0\ 
for  SRTS,  and  p=.5  for  the  standard  intervention.  We  also  observed  strong  correlations 
between  minutes  of  SRTS  usage  and  the  change  in  overall  stress  score  in  the  SRTS 
group,  with  R^=.58,/><.01  (Figure  1). 


Total  minutes  of  iPad  usage 


Figure  1,  Change  in  overall  stress  as  a  function  of  minutes  of  SRTS  usage  during  the  study 
period. 
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5.6  SRTS  Usage 

As  discussed  above,  we  observed  a  signifieant  correlation  between  total  minutes  of  SRTS 
usage  and  overall  stress  ratings,  though  no  significant  correlation  with  our  other 
struetured  measures.  Total  average  SRTS  usage  was  142  minutes  per  person,  which  was 
considerably  lower  than  the  requested  480  minutes  (60  minutes  per  week  over  the  8  week 
study  period).  Informal  feedback  indicated  that  many  partieipants  used  the  iPad  for  a  few 
sessions  early  in  the  study  period  and  then  discontinued  usage  for  a  variety  of  reasons, 
including  low  motivation  and  concerns  about  losing  or  damaging  the  deviees. 

6.0  DISCUSSION 

The  impact  of  this  study  was  impaired  by  the  low  participation  rate  and  the  relatively  low 
complianee  amongst  enrolled  participants.  Even  with  the  low  partieipation  rate,  we  did 
observe  positive  effects  on  overall  stress  and  a  strong  correlation  with  usage,  whieh 
indicates  that  the  impact  of  using  SRTS  is  dose-dependent;  with  higher  compliance,  we 
would  expect  stronger  positive  effeets. 

The  lack  of  significant  impact  on  burnout  and  role  stress  is  unsurprising.  The  typieal  time 
course  of  oeeupational  burnout  plays  out  over  mueh  longer  periods  of  time  than  the  eight 
week  period  of  this  study  (e.g.  Vinokur,  Pieree,  &  Lewandowski-Romps,  2009). 

Improved  stress  resilienee  and  decreased  oeeupational  stress  would  be  expected  to 
positively  impaet  burnout  on  the  scale  of  one  year  or  more.  Future  work  with  SRTS  and 
similar  systems  should  consider  longer-term  follow  up  assessment  to  test  this  hypothesis. 

Based  on  these  results  and  given  the  limitations  already  identified,  we  conclude  that 
while  SRTS  is  not  a  replacement  for  mental  health  support,  it  has  signifieant  potential  for 
enhaneing  care  and  reinforcing  physiologically-informed  stress  eoping  teehniques. 
Compliance  is  a  key  factor  and  should  be  enhanced  as  much  as  possible  via  improved 
gamification  and  strong  mentoring  support.  Consequently,  we  reeommend  SRTS  usage  in 
an  environment  facilitating  mentor  support,  such  as  via  Airman  and  Family  Readiness 
Centers  and/or  the  Medieal  Group.  We  would  also  reasonably  expect  the  strongest 
positive  effects  to  be  observed  with  Airmen  who  are  younger  and  highly  stressed,  as  they 
are  less  likely  to  have  well-developed  eoping  skills  and  support  networks. 

7.0  CONCLUSIONS 

Biofeedback  and  cognitive  learning  approaches  to  stress  resilience  have  shown  some 
promise,  though  further  study  and  refinement  of  delivery  meehanisms  is  warranted  prior 
to  eonsideration  of  large-seale  deployment  of  systems  such  as  SRTS. 
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9.0  LIST  OF  ABBREVIATIONS  AND  ACRONYMS 


AF 

APA 

DSM-IV-TR 

HRV 

MBI-GS 

NASA-TLX 

PCL-M 

PTSD 

RPA 

SRTS 

OQ45 


Air  Force 

American  Psychological  Association 

Diagnostic  and  Statistical  Manual  for  Mental  Disorders,  4*  ed.,  text 
revision 

Heart  rate  variability 

Maslach  Burnout  Inventory  General  Survey 

National  Aeronautics  and  Space  Administration-  Task  Load  Index 

Post-traumatie  stress  disorder  checklist,  military  version 

Post-traumatic  stress  disorder 

Remotely  piloted  aircraft 

Stress  Resilience  Training  System 

Outcome  Questionnaire-  45.2 
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